Development and testing of a multi-lingual Natural Language Processing-based deep learning system in 10 languages for COVID-19 pandemic crisis: A multi-center study

Purpose The COVID-19 pandemic has drastically disrupted global healthcare systems. With the higher demand for healthcare and misinformation related to COVID-19, there is a need to explore alternative models to improve communication. Artificial Intelligence (AI) and Natural Language Processing (NLP) have emerged as promising solutions to improve healthcare delivery. Chatbots could fill a pivotal role in the dissemination and easy accessibility of accurate information in a pandemic. In this study, we developed a multi-lingual NLP-based AI chatbot, DR-COVID, which responds accurately to open-ended, COVID-19 related questions. This was used to facilitate pandemic education and healthcare delivery. Methods First, we developed DR-COVID with an ensemble NLP model on the Telegram platform (https://t.me/drcovid_nlp_chatbot). Second, we evaluated various performance metrics. Third, we evaluated multi-lingual text-to-text translation to Chinese, Malay, Tamil, Filipino, Thai, Japanese, French, Spanish, and Portuguese. We utilized 2,728 training questions and 821 test questions in English. Primary outcome measurements were (A) overall and top 3 accuracies;(B) Area Under the Curve (AUC), precision, recall, and F1 score. Overall accuracy referred to a correct response for the top answer, whereas top 3 accuracy referred to an appropriate response for any one answer amongst the top 3 answers. AUC and its relevant matrices were obtained from the Receiver Operation Characteristics (ROC) curve. Secondary outcomes were (A) multi-lingual accuracy;(B) comparison to enterprise-grade chatbot systems. The sharing of training and testing datasets on an open-source platform will also contribute to existing data. Results Our NLP model, utilizing the ensemble architecture, achieved overall and top 3 accuracies of 0.838 [95% confidence interval (CI): 0.826–0.851] and 0.922 [95% CI: 0.913–0.932] respectively. For overall and top 3 results, AUC scores of 0.917 [95% CI: 0.911–0.925] and 0.960 [95% CI: 0.955–0.964] were achieved respectively. We achieved multi-linguicism with nine non-English languages, with Portuguese performing the best overall at 0.900. Lastly, DR-COVID generated answers more accurately and quickly than other chatbots, within 1.12–2.15 s across three devices tested. Conclusion DR-COVID is a clinically effective NLP-based conversational AI chatbot, and a promising solution for healthcare delivery in the pandemic era.

Development and testing of a multi-lingual Natural Language Processing-based deep learning system in 10 languages for COVID-19 pandemic crisis: A multi-center study.

Purpose: The COVID-19 pandemic has drastically disrupted global healthcare systems. With the higher demand for healthcare and misinformation related to COVID-19, there is a need to explore alternative models to improve communication. Artificial Intelligence (AI) and Natural Language Processing (NLP) have emerged as promising solutions to improve healthcare delivery. Chatbots could fill a pivotal role in the dissemination and easy accessibility of accurate information in a pandemic. In this study, we developed a multi-lingual NLP-based AI chatbot, DR-COVID, which responds accurately to open-ended, COVID-19 related questions. This was used to facilitate pandemic education and healthcare delivery. Methods: First, we developed DR-COVID with an ensemble NLP model on the Telegram platform (https://t.me/drcovid_nlp_chatbot). Second, we evaluated various performance metrics. Third, we evaluated multi-lingual text-to-text translation to Chinese, Malay, Tamil, Filipino, Thai, Japanese, French, Spanish, and Portuguese. We utilized 2,728 training questions and 821 test questions in English. Primary outcome measurements were (A) overall and top 3 accuracies; (B) Area Under the Curve (AUC), precision, recall, and F1 score. Overall accuracy referred to a correct response for the top answer, whereas top 3 accuracy referred to an appropriate response for any one answer amongst the top 3 answers. AUC and its relevant matrices were obtained from the Receiver Operation Characteristics (ROC) curve. Secondary outcomes were (A) multi-lingual accuracy; (B) comparison to enterprise-grade chatbot systems. The sharing of training and testing datasets on an open-source platform will also contribute to existing data. Results: Our NLP model, utilizing the ensemble architecture, achieved overall and top 3 accuracies of 0.838 [95% confidence interval (CI): 0.826-0.851] and 0.922 [95% CI: 0.913-0.932] respectively. For overall and top 3 results, AUC scores of 0.917 [95% CI: 0.911-0.925] and 0.960 [95% CI: 0.955-0.964] were achieved respectively. We achieved multi-linguicism with nine non-English languages, with Portuguese performing the best overall at 0.900. Lastly, DR-COVID generated answers more accurately and quickly than other chatbots, within 1.12-2.15 s across three devices tested. Conclusion: DR-COVID is a clinically effective NLP-based conversational AI chatbot, and a promising solution for healthcare delivery in the pandemic era.

Metaverse and Virtual Health Care in Ophthalmology: Opportunities and Challenges.

ABSTRACT: The outbreak of the coronavirus disease 2019 has further increased the urgent need for digital transformation within the health care settings, with the use of artificial intelligence/deep learning, internet of things, telecommunication network/virtual platform, and blockchain. The recent advent of metaverse, an interconnected online universe, with the synergistic combination of augmented, virtual, and mixed reality described several years ago, presents a new era of immersive and real-time experiences to enhance human-to-human social interaction and connection. In health care and ophthalmology, the creation of virtual environment with three-dimensional (3D) space and avatar, could be particularly useful in patient-fronting platforms (eg, telemedicine platforms), operational uses (eg, meeting organization), digital education (eg, simulated medical and surgical education), diagnostics, and therapeutics. On the other hand, the implementation and adoption of these emerging virtual health care technologies will require multipronged approaches to ensure interoperability with real-world virtual clinical settings, user-friendliness of the technologies and clinical efficiencies while complying to the clinical, health economics, regulatory, and cybersecurity standards. To serve the urgent need, it is important for the eye community to continue to innovate, invent, adapt, and harness the unique abilities of virtual health care technology to provide better eye care worldwide.

The Impact and Applications of Social Media Platforms for Public Health Responses Before and During the COVID-19 Pandemic: Systematic Literature Review.

BACKGROUND: Social media platforms have numerous potential benefits and drawbacks on public health, which have been described in the literature. The COVID-19 pandemic has exposed our limited knowledge regarding the potential health impact of these platforms, which have been detrimental to public health responses in many regions. OBJECTIVE: This review aims to highlight a brief history of social media in health care and report its potential negative and positive public health impacts, which have been characterized in the literature. METHODS: We searched electronic bibliographic databases including PubMed, including Medline and Institute of Electrical and Electronics Engineers Xplore, from December 10, 2015, to December 10, 2020. We screened the title and abstracts and selected relevant reports for review of full text and reference lists. These were analyzed thematically and consolidated into applications of social media platforms for public health. RESULTS: The positive and negative impact of social media platforms on public health are catalogued on the basis of recent research in this report. These findings are discussed in the context of improving future public health responses and incorporating other emerging digital technology domains such as artificial intelligence. However, there is a need for more research with pragmatic methodology that evaluates the impact of specific digital interventions to inform future health policy. CONCLUSIONS: Recent research has highlighted the potential negative impact of social media platforms on population health, as well as potentially useful applications for public health communication, monitoring, and predictions. More research is needed to objectively investigate measures to mitigate against its negative impact while harnessing effective applications for the benefit of public health.

COVID-19 awareness, knowledge and perception towards digital health in an urban multi-ethnic Asian population.

This study aimed to determine COVID-19-related awareness, knowledge, impact and preparedness among elderly Asians; and to evaluate their acceptance towards digital health services amidst the pandemic. 523 participants (177 Malays, 171 Indians, 175 Chinese) were recruited and underwent standardised phone interview during Singapore's lockdown period (07 April till 01 June 2020). Multivariable logistic regression models were performed to evaluate the associations between demographic, socio-economic, lifestyle, and systemic factors, with COVID-19 awareness, knowledge, preparedness, well-being and digital health service acceptance. The average perception score on the seriousness of COVID-19 was 7.6 ± 2.4 (out of 10). 75.5% of participants were aware that COVID-19 carriers can be asymptomatic. Nearly all (≥ 90%) were aware of major prevention methods for COVID-19 (i.e. wearing of mask, social distancing). 66.2% felt prepared for the pandemic, and 86.8% felt confident with government's handling and measures. 78.4% felt their daily routine was impacted. 98.1% reported no prior experience in using digital health services, but 52.2% felt these services would be helpful to reduce non-essential contact. 77.8% were uncomfortable with artificial intelligence software interpreting their medical results. In multivariable analyses, Chinese participants felt less prepared, and more likely felt impacted by COVID-19. Older and lower income participants were less likely to use digital health services. In conclusion, we observed a high level of awareness and knowledge on COVID-19. However, acceptance towards digital health service was low. These findings are valuable for examining the effectiveness of COVID-19 communication in Singapore, and the remaining gaps in digital health adoption among elderly.

Applications of digital health for public health responses to COVID-19: a systematic scoping review of artificial intelligence, telehealth and related technologies.

The coronavirus disease 2019 (COVID-19) pandemic has overwhelmed healthcare services, faced with the twin challenges in acutely meeting the medical needs of patients with COVID-19 while continuing essential services for non-COVID-19 illnesses. The need to re-invent, re-organize and transform healthcare and co-ordinate clinical services at a population level is urgent as countries that controlled initial outbreaks start to experience resurgences. A wide range of digital health solutions have been proposed, although the extent of successful real-world applications of these technologies is unclear. This study aims to review applications of artificial intelligence (AI), telehealth, and other relevant digital health solutions for public health responses in the healthcare operating environment amidst the COVID-19 pandemic. A systematic scoping review was performed to identify potentially relevant reports. Key findings include a large body of evidence for various clinical and operational applications of telehealth (40.1%, n = 99/247). Although a large quantity of reports investigated applications of artificial intelligence (AI) (44.9%, n = 111/247) and big data analytics (36.0%, n = 89/247), weaknesses in study design limit generalizability and translation, highlighting the need for more pragmatic real-world investigations. There were also few descriptions of applications for the internet of things (IoT) (2.0%, n = 5/247), digital platforms for communication (DC) (10.9%, 27/247), digital solutions for data management (DM) (1.6%, n = 4/247), and digital structural screening (DS) (8.9%, n = 22/247); representing gaps and opportunities for digital public health. Finally, the performance of digital health technology for operational applications related to population surveillance and points of entry have not been adequately evaluated.

Telehealth Demand Trends During the COVID-19 Pandemic in the Top 50 Most Affected Countries: Infodemiological Evaluation.

BACKGROUND: The COVID-19 pandemic has led to urgent calls for the adoption of telehealth solutions. However, public interest and demand for telehealth during the pandemic remain unknown. OBJECTIVE: We used an infodemiological approach to estimate the worldwide demand for telehealth services during COVID-19, focusing on the 50 most affected countries and comparing the demand for such services with the level of information and communications technology (ICT) infrastructure available. METHODS: We used Google Trends, the Baidu Index (China), and Yandex Keyword Statistics (Russia) to extract data on worldwide and individual countries' telehealth-related internet searches from January 1 to July 7, 2020, presented as relative search volumes (RSV; range 0-100). Daily COVID-19 cases and deaths were retrieved from the World Health Organization. Individual countries' ICT infrastructure profiles were retrieved from the World Economic Forum Report. RESULTS: Across the 50 countries, the mean RSV was 18.5 (SD 23.2), and the mean ICT index was 62.1 (SD 15.0). An overall spike in worldwide telehealth-related RSVs was observed from March 11, 2020 (RSV peaked to 76.0), which then tailed off in June-July 2020 (mean RSV for the period was 25.8), but remained higher than pre-March RSVs (mean 7.29). By country, 42 (84%) manifested increased RSVs over the evaluation period, with the highest observed in Canada (RSV=100) and the United States (RSV=96). When evaluating associations between RSV and the ICT index, both the United States and Canada demonstrated high RSVs and ICT scores (≥70.3). In contrast, European countries had relatively lower RSVs (range 3.4-19.5) despite high ICT index scores (mean 70.3). Several Latin American (Brazil, Chile, Colombia) and South Asian (India, Bangladesh, Pakistan) countries demonstrated relatively higher RSVs (range 13.8-73.3) but low ICT index scores (mean 44.6), indicating that the telehealth demand outstrips the current ICT infrastructure. CONCLUSIONS: There is generally increased interest and demand for telehealth services across the 50 countries most affected by COVID-19, highlighting the need to scale up telehealth capabilities, during and beyond the pandemic.